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(54) Ethernet communication redundancy method 



(57) In a redundancy method for Ethernet communi- 
cation between a plurality of nodes constituting a distrib- 
uted control system, the nodes are connected to each 
other in a duplex state through first and second Ethernet 
communication lines which are independent of each 
other. A node on the transmission side transmits identi- 
cal data to both the first and second Ethernet communi- 

.10 



cation lines. A node on the reception side determines 
one of the identical data received from the node on the 
transmission side through the first and second Ethernet 
communication lines which has arrived first as reception 
data. 
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Description 

Background of the Invention 

The present invention relates to an Ethernet com- 
munication redundancy method and, more particularly, 
to an Ethernet communication redundancy method of 
making a communication system redundant between a 
plurality of nodes connected to each other through 
Ethernet communication lines to constitute a distributed 
control system. 

In general, in a distributed control system (DCS) for 
controlling each node to be controlled by using a corre- 
sponding one of a plurality of nodes (terminals), a com- 
munication system for connecting the respective nodes 
is made redundant to increase the operation rate of the 
overall system, thereby efficiently controlling the sys- 
tem. When a communication scheme using a token, 
e.g., token passing, is used as a communication 
scheme between the respective nodes, since the cyclic 
period of the token can be calculated, disconnection in 
the communication system or the like can be detected 
by checking this cyclic cycle. 

Assume that a communication scheme using such 
a token is used as the communication system of a dis- 
tributed control system. In this case, a system and 
method which switch redundant systems for communi- 
cation in response to disconnection or a communication 
failure in this communication system as a trigger are 
conceivable. 

As personal computers become widespread and 
improve in performance, personal computers connected 
as nodes through Ethernet are now in increasing 
demand. The communication system of a distributed 
control system may therefore be made redundant by 
using Ethernet widely used in the field of personal com- 
puters. 

In such a conventional redundancy method, how- 
ever, when one Ethernet communication line is used for 
a communication system, since the communication line 
is shared by a plurality of nodes, the time taken for com- 
munication greatly varies due to contention control and 
the like. For this reason, this method cannot be used for 
a distributed control system which is required to 
exchange measurement data and control commands 
without any great delay. 

For example, in Ethernet, CSMA/CD (Carrier 
Sense Multiple Access with Collision Detection) is used 
as a contention control method. According to this 
method, when one communication line is shared by a 
plurality of nodes, data is transmitted to the communica- 
tion line after it is determined that the communication 
line is not in use. If, therefore, different nodes simultane- 
ously start transmitting data, a collision occurs. 

The probability of occurrence of collision increases 
as the number of nodes and the communication fre- 
quency increase. When a collision occurs, retry is per- 
formed (for example, 16 times = several hundred ms on 



the MAC layer). In this case, the time required for com- 
munication greatly varies. This method cannot therefore 
be used for process control that is required to exchange 
measurement data and control commands without any 

s great delay. 

In a redundancy scheme designed to switch com- 
munication lines, when a failure occurs in one of the 
communication lines, the failed communication line 
must be repaired while communication is performed 

10 exclusively through the normal communication line. 

Summary of the Invention 

It is an object of the present invention to provide an 

75 Ethernet communication redundancy method which can 
exchange measurement data and control commands 
without any great delay. 

It is another object of the present invention to pro- 
vide an Ethernet communication redundancy method 

20 which need not switch communication lines. 

In order to achieve the above objects, according to 
the present invention, there is provided a redundancy 
method for Ethernet communication between a plurality 
of nodes constituting a distributed control system, com- 

25 prising the steps of connecting said nodes to each other 
in a duplex state through first and second Ethernet com- 
munication lines which are independent of each other, 
causing a node on a transmission side to transmit iden- 
tical data to both the first and second Ethernet commu- 

30 nication lines, and causing a node on a reception side to 
determine one of the identical data received from the 
node on the transmission side through the first and sec- 
ond Ethernet communication lines which has arrived 
first as reception data. 

35 

Brief Description of the Drawings 

Fig. 1 is a block diagram showing a distributed con- 
trol system using Ethernet communication accord - 

40 ing to the first embodiment of the present invention; 
Fig. 2 is a view for explaining the format of transmis- 
sion data which is used in the system in Fig. 1 ; 
Fig. 3 is a flow chart showing transmission process- 
ing in the system in Fig. 1 ; 

45 Fig. 4 is a f low chart showing reception processing 
in the system in Fig. 1 ; 

Fig. 5 is a flow chart showing reception processing 
in a distributed control system using Ethernet com- 
munication according to the second embodiment of 
50 the present invention; and 

Fig. 6 is a flow chart showing abnormality detection 
processing in the system according to the second 
embodiment of the present invention. 

ss Description of the Preferred Embodiments 

The present invention will be described in detail 
below with reference to the accompanying drawings. 
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Fig. 1 shows a distributed control system using 
Ethernet communication according to an embodiment 
of the present invention. Referring to Fig. 1 , a system- A 
communication line 1 and a system-B communication 
line 2 are communication lines used to perform Ethernet 5 
communication between a plurality of nodes such as 
nodes 10 and 20. With this arrangement, communica- 
tion to be performed between the respective nodes is 
duplexed. 

The nodes 10 and 20 are respectively constituted 10 
by system-A devices 1 1 ami 21 serving as interfaces for 
exchanging data through the system-A communication 
line 1 t system-B devices 12 and 22 serving as inter- 
faces for exchanging data through the system-B com- 
munication line 2, buffer sections 13 and 23 for is 
temporarily storing data to be transmitted/received, sys- 
tem-A reception queues 14 and 24 for storing pieces of 
information for the management of the data received 
through the system-A communication line 1, system-B 
reception queues 15 and 25 for storing pieces of infor- 20 
mation for the management of the data received 
through the system-B communication line 2, and control 
sections 16 and 26 for controlling data transmis- 
sion/reception processing in accordance with com- 
mands from upper applications 1 7 and 27. 25 

Data transmission from the node 10 to the node 20 
will be described next with reference to Figs. 3 and 4. 

The control section 16 of the node 10 on the trans- 
mission side starts the transmission processing shown 
in Fig. 3 in accordance with a transmission command 30 
from the upper application 17. First of all, the control 
section 1 6 adds a data identifier for identifying transmis- 
sion data to the transmission data received from the 
upper application 17 (step S101). 

In this case, as shown in Fig. 2, the transmission 35 
data includes a header portion 5 in which various pieces 
of control information used for Ethernet are stored, a 
data portion 6 as the essential transmission data to be 
transmitted, and a data identifier 7 for identifying the 
contents of the data portion 6. In the header portion 5, 40 
for example, addresses indicating source and destina- 
tion nodes are stored by the system-A device 1 1 and the 
system-B device 12. 

In the data portion 6, data obtained by adding the 
data identifier 7 to the data received from the upper 45 
application 1 7 is stored by the control section 1 6. As this 
data identifier 7, a unique value in an interval sufficiently 
longer than the interval between the instant at which the 
identifier is added and the instant at which reception 
processing is performed in the node on the reception so 
side is used in consideration of various types of trans- 
mission delays. In practice, as the data identifier 7, one 
of consecutive sequence numbers circulating with a 
length that satisfies the requirement for the above inter- 
val when data are transmitted at the shortest data trans- ss 
mission intervals, or a combination of such a sequence 
number and information indicating the node on the 
transmission side is used. 



The transmission data generated in this manner is 
stored in each of predetermined transmission areas in 
the buffer section 13 which are arranged in correspond- 
ence with the system-A device 1 1 and the system-B 
device 12. The system-A device 11 and the system-B 
device 12 respectively check the corresponding prede- 
termined transmission areas in the buffer section 13 at 
a predetermined timing. When the transmission data 
are stored in the buffer section 13, the system-A device 
1 1 and the system-B device 12 add the header portions 
5 to the data, and transmit the resultant data upon 
checking whether the system-A communication line 1 
and the system-B communication line 2 are available 
(steps S102 and S103). Wrth this operation, the trans- 
mission data from the upper application 17 are concur- 
rently transmitted from the node 10 to both the system- 
A communication line 1 and the system-B communica- 
tion line 2. 

The control section 26 of the node 20 on the recep- 
tion side starts the reception processing shown in Fig. 4 
in accordance with a reception command from the 
upper application 27. First of all, the control section 26 
checks whether reception data are stored in predeter- 
mined reception areas in the buffer section 23 (step 
S1 1 1). Note that the buffer section 23 has independent 
reception areas for temporarily storing reception data in 
correspondence with the system-A device 21 and the 
system-B device 22. 

The system-A device 21 and the system-B device 
22 always check the header portions 5 of data flowing in 
the system-A communication line 1 and the system-B 
communication line 2. Each device receives transmis- 
sion data addressed thereto and stores it in the corre- 
sponding reception area in the buffer section 23. As 
described above, the control section 26 checks the 
respective reception areas in the buffer section 23 
which correspond to the system-A device 21 and the 
system-B device 22 in step S1 11. If reception data is 
stored in none of the reception areas, the control sec- 
tion 26 notifies the upper application 27 of the corre- 
sponding information (step S116). and terminates the 
reception processing. 

If reception data is stored in any of the reception 
areas in the buffer section 23. the control section 26 
checks whether the reception data is stored in the 
reception area corresponding to the system-A device 21 
or the system-B device 22 (step S1 12). If the reception 
data is stored in the reception area corresponding to the 
system-A device 21, i.e., the reception data is received 
from the system-A communication line 1, the control 
section 26 checks whether data identical to the recep- 
tion data has already been received from the system-B 
communication line 2 (step S1 13). 

Whether data identical to the reception data has 
already been received, i.e., whether the received data is 
the first reception data of the identical data concurrently 
transmitted to the system-A communication line 1 and 
the system-B communication line 2, is determined by 
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referring to a reception queue in the other system. 

In the system-A reception queue 24 and the sys- 
tem-B reception queue 25, pieces of identification infor- 
mation indicating received data, e.g., the data identifiers 
7 in Fig. 2 which were added to the transmission data 5 
when they were transmitted, are registered. In step 
S1 13, therefore, the control section 26 refers to the sys- 
tem-B reception queue 25 to check whether there is 
identification information indicating data identical to the 
reception data. If the identical reception data has not 10 
been received, the identification information indicating 
the reception data is registered in the system-A recep- 
tion queue 24 (step S1 14). 

Subsequently, the control section 26 notifies the 
upper application 27 of the reception data (step S1 16), is 
and terminates the reception processing. 

If it is determined in step S1 13 that identical recep- 
tion data has already been received, the system-A 
reception data received later is discarded, and the iden- 
tification information indicating data identical to the A- 20 
system reception data is deleted from the system-B 
reception queue 25 (step S115). Thereafter, the flow 
returns to step Si 1 1 to check the presence/absence of 
reception data. 

If it is determined in step S1 12 that reception data 25 
is stored in the reception area corresponding to the sys- 
tem-B device 22, i.e., reception data is received from 
the system-B communication line 2, the control section 
26 refers to the system-A reception queue 24 to check 
whether data identical to the reception data has already 30 
been received from the system-A communication line 1 
(step S123). If no data identical to the reception data 
has been received, identification information indicating 
the reception data is registered in the system-B recep- 
tion queue 25 (step S1 24). 35 

.After this operation, the control section 26 notifies 
the upper application 27 of the reception data (step 
S1 16), and terminates the reception processing. 

If it is determined in step S123 that identical recep- 
tion data has already been received, the system-B 40 
reception data received later is discarded, and identifi- 
cation information indicating data identical to the sys- 
tem-B reception data is deleted from the system-A 
reception queue 24 (step S125). The flow then returns 
to step S1 1 1 to check the presence/absence of recep- 45 
tion data. 

According to this embodiment the respective 
nodes are connected through the two Ethernet commu- 
nication lines, i.e., the system-A communication line 1 
and the system-B communication line 2. The node 10 so 
on the transmission side concurrently transmits trans- 
mission data to the system-A communication line 1 and 
the system-B communication line 2. The node 20 on the 
reception side checks whether data identical to the 
reception data received from one of the system-A com- 55 
munication line 1 and the system-B communication line 
2 has already been received from the other communica- 
tion line, i.e.. the reception data is the first data. If no 



identical data has been received, the upper application 
is notified of the reception data. If identical reception 
data has been received, the data is discarded. With this 
operation, variations in the time required for communi- 
cation due to collisions can be reduced, and measure- 
ment data and control commands can be exchanged 
without any great delay as compared with the communi- 
cation system using one Ethernet communication line. 

The node 10 on the transmission side transmits 
transmission data upon adding a data identifier for iden- 
tifying the transmission data. The node 20 on the recep- 
tion side checks on the basts of the data identifier added 
to the reception data whether data identical to the 
reception data has already been received. With this 
operation, the presence/absence of identical data can 
be accurately determined. This system is therefore opti- 
mal for process control in which identical measurement 
data and the like may be consecutively transmitted. 

The second embodiment of the present invention 
will be described next with reference to Figs. 5 and 6. 
Note that since the system configuration and the data 
format in this embodiment are the same as those 
described with reference to Figs. 1 and 2, a description 
thereof will be omitted. The processing in the second 
embodiment differs from that in the first embodiment in 
that system-A and system-B communication abnormal- 
ity detection processing and associated processing are 
added to reception processing, and pieces of identifica- 
tion information indicating received data and pieces of 
corresponding reception time information are stored in 
the system-A and system-B reception queues in the 
node on the reception side to perform abnormality 
detection. 

Data transmission from a node 10 to a node 20 in 
the second embodiment will be described below. First of 
all, a control section 16 of the node 10 on the transmis- 
sion side starts the transmission processing shown in 
Fig. 3 in accordance with a transmission command from 
an upper application 17. This transmission processing 
is the same as that described above, and hence a 
description thereof will be omitted. With this transmis- 
sion processing, transmission data from the upper 
application 17 are concurrently transmitted from the 
node 10 to both a system-A communication line 1 and a 
system-B communication line 2. 

A control section 26 of the node 20 on the reception 
side starts the reception processing shown in Fig. 5 in 
accordance with a reception command from a an upper 
application 27. Note that the same step numbers in Fig. 
5 denote the same steps as in Fig. 4, and a description 
thereof will be omitted. 

If it is determined in step S1 12 that reception data 
has been stored in a reception area corresponding to a 
system-A device 21, i.e., reception data has been 
received from the system-A communication line 1 , the 
control section 26 checks whether the system A is set in 
an abnormal communication state (step S118). Detec- 
tion of a communication abnormality in each system is 
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periodically executed by the abnormality detection 
processing shown in Fig. 6 independently of transmis- 
sion processing and reception processing. 

If it is determined in step S1 18 that the system A is 
set in the abnormal communication state, since new s 
data has been normally received, the control section 26 
determines that the communication state is normal, and 
restores the communication slate of the system A to the 
normal state (step S119). The control section 26 then 
checks whether data identical to the reception data from 10 
the system A has been received from the system-B 
communication line 2 (step S1 13). if it is determined in 
step S1 18 that the communication state is normal, the 
flow also advances to step S1 13. 

Pieces of identification information indicating is 
received data, e.g., data identifiers 7 shown in Fig. 2 
added to transmission data when they are transmitted, 
and pieces of corresponding reception time information 
are stored in system-A and system-B reception queues 
24 and 25. In step S1 1 3, the control section 26 refers to 20 
the system-B reception queue 25 to check whether 
there is identification information indicating data identi- 
cal to the reception data. If no identical reception data 
has been received, the control section 26 registers the 
identification information indicating the reception data in 25 
the system-A reception queue 24 (step S1 14). 

If it is determined in step S112 that reception data 
has been stored in a reception area corresponding to a 
system-B device 22, i.e., reception data has been 
received from the system-B communication line 2, the 30 
control section 26 checks whether the system B is set in 
the abnormal communication state (step S128). If the 
system B is set in the abnormal communication state, 
since new data has been normally received, the control 
section 26 determines that the communication state is 35 
normal, and restores the communication state of the 
system B to the normal state (step S129). 

The control section 26 then checks whether data 
identical to the reception data has been received from 
the system-A communication line 1 (step S123). If it is 40 
determined in step S128 that the communication state 
of the system B is normal, the flow also advances to 
step S123. 

The control section 26 of the node 20 periodically 
executes the abnormality detection processing shown in 45 
Fig. 6 independently of the reception processing 
described with reference to Fig. 5. 

First of all, the control section 26 checks whether 
reception data is registered in the system-A reception 
queue 24 (step S131). If any reception data are regis- so 
tered, the reception times of all the registered reception 
data are compared with the current time to check 
whether any reception data has undergone a predeter- 
mined timeout after the reception time (step S132). 

If any reception data has undergone the predeter- ss 
mined timeout after the reception time, the control sec- 
tion 26 determines that data identical to the reception 
data in the system A has not received in the system B 



after the lapse of the timeout period, and reception 
abnormality has occurred in the system B, and sets the 
system B in the abnormal communication state (step 
S133). The control section 26 then deletes information 
about the reception data having undergone the timeout 
from the system-A reception queue 24 (step S134). 

Subsequently, in steps S135 to S138, abnormality 
detection processing for the system B is executed in the 
same manner as the abnormality detection processing 
for the system A in steps S131 to S134. 

According to this embodiment, the pieces of identi- 
fication information and received data and the pieces of 
corresponding reception time information are registered 
in the system-A reception queue 24 and the system-B 
reception queue 25. When a timeout occurs in one sys- 
tem after the reception of data, and no data is received 
in the other system, it is determined that communication 
abnormality has occurred in the other system, and the 
information registered in the reception queue is deleted. 
With this operation, the occurrence of communication 
abnormality can be accurately determined. In addition, 
even if communication abnormality occurs in the other 
system, and reception of identical data cannot be 
checked, the reception queue in the normal system 
does not overflow, and reception processing for subse- 
quent data can be accurately performed. 

When new data is received from a system in the 
abnormal communication state, the communication 
state of this system is restored to the normal state. Even 
if, therefore, communication abnormality occurs acci- 
dentally or temporarily, the communication state of the 
system can be automatically restored to the normal 
state, thereby greatly reducing the maintenance load 
required to restore from the abnormal state. 

As has been described above, according to the 
present invention, variations in the time required for 
communication due to collisions and the like can be 
reduced, and measurement data and control com- 
mands can be exchanged without any great delay as 
compared with a system using one Ethernet communi- 
cation line as a communication system. 

In addition, since it is checked on the basis of a data 
identifier added to reception data on the node on the 
transmission side whether the reception data is the first 
received data, the reception of identical data can be 
easily determined. Therefore, this system can also be 
used for process control in which identical measure- 
ment data and the like may be consecutively transmit- 
ted. 

Furthermore, since the timeout of reception data is 
monitored to check the occurrence of communication 
abnormality in one of Ethernet communication lines, the 
occurrence of communication abnormality can be accu- 
rately determined. In addition, reception processing for 
subsequent data can be accurately executed. 

Moreover, the communication state of an Ethernet 
communication line is restored to the normal state in 
accordance with the reception state. Even if, therefore, 
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communication abnormality occurs accidentally or tem- 
porarily, the communication state of the system can be 
automatically restored to the normal state, thereby 
greatly reducing the maintenance load required to 
restore from the abnormal state. s 

Claims 

1 . A redundancy method for Ethernet communication 
between a plurality of nodes (10, 20) constituting a 10 
distributed control system, characterized by com- 
prising the steps of: 

connecting said nodes to each other in a 
duplex state through first and second Ethernet is 
communication lines (1, 2) which are independ- 
ent of each other; 

causing a node on a transmission side to trans- 
mit identical data to both the first and second 
Ethernet communication lines; and 20 
causing a node on a reception side to deter- 
mine one of the identical data received from the 
node on the transmission side through the first 
and second Ethernet communication lines 
which has arrived first as reception data. 25 

5. 

2. A method according to claim 1, further comprising 
the step of causing the node on the transmission 
side to add a data identifier for identifying data to 
data to be transmitted, and 30 

wherein the step of causing the node on the 
reception side to determine comprises checking on 
the basis of the data identifier added to the data 
from the node on the transmission side whether the 
data from the node on the transmission side is data 35 
that has arrived first through one of the first and 
second Ethernet communication lines. 

6. 

3. A method according to claim 2, wherein the step of 
causing the node on the reception side to deter- 40 
mine comprises the steps of: 

independently receiving data transmitted 
through the first and second Ethernet commu- 
nication lines and temporarily storing the data; 45 
storing data identifiers of the received data in 7. 
correspondence with the first and second 
Ethernet communication lines; and 

when the data identifier of the data 
transmitted through the first Ethernet communi- so 
cation line is not stored in correspondence with 
the second Ethernet communication line, 
determining that the temporarily stored data is 
reception data. 

55 

4. A method according to claim 3, further comprising 
the steps of: 



causing the node on the reception side to store 
the data identifiers of the received data and 
pieces of reception time information of the data 
in correspondence with the first and second 
Ethernet communication lines; 

when the data identifier of the data 
transmitted through the second Ethernet com- 
munication line is stored in correspondence 
with the first Ethernet communication line, 
deleting the data identifier and the reception 
time information of the data stored in corre- 
spondence with the first Ethernet communica- 
tion line; 

determining whether the data identifier stored 
in correspondence with the first Ethernet com- 
munication line has undergone a lapse of a 
predetermined time after a reception time of 
the stored data; and 

when the determination result indicates 
that the predetermined time has elapsed, 
deleting the data identifier and the reception 
time information of the data which are stored in 
correspondence with the first Ethernet commu- 
nication line. 

A method according to claim 4, further comprising 
the steps of: 

when the determination result indicates that 
the predetermined time has elapsed, setting the 
second Ethernet communication line in an abnor- 
mal communication state; and 

when data is normally received through the 
second Ethernet communication line set in the 
abnormal communication state, restoring the 
abnormal communication state of the second 
Ethernet communication line to a normal state. 

A method according to claim 4, further comprising 
the step of, when a data identifier of data transmit- 
ted through the second Ethernet communication 
line is stored in correspondence with the first Ether- 
net communication line, discarding the data tempo- 
rarily stored through the second Ethernet 
communication line. 

A method according to claim 1 , further comprising 
the steps of: 

causing the node on the reception side to store 
pieces of reception time information of data in 
correspondence with the first and second 
Ethernet communication lines; and 

when data identical to the data received 
through the first Ethernet communication fine is 
not received through the second Ethernet com- 
munication line even when a predetermined 
time has elapsed after a reception time of the 
registered data, determining that communica- 
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tion abnormality has occurred in the second 
Ethernet communication line, and deleting the 
reception time information of the data stored in 
correspondence with the first Ethernet commu- 
nication line. 5 
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YES 



.z: 



NO 
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RESTORE SYSTEM-B 
TO NORMAL STATE 



HAS IDENTICAL DATA 
RECEIVED FROM 
SYSTEM-A? 



NO 



REGISTER RECEPTION 
DATA IN SYSTEM-B 
RECEPTION QUEUE 



DISCARD RECEPTION DATA 
AND DELETE IDENTIFICATION 
INFORMATION FROM 
SYSTEM-B QUEUE 

^sii5 




1 
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DISCARD RECEPTION DATA 
AND DELETE IDENTIFICATION 
INFORMATION FROM 
SYSTEM-A QUEUE 



6 
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f ABNORMALITY DETECTION^ 
V PROCESSING J 

I 

DATA IN SYSTEM-A 
RECEPTION QUEUE? 



YES 



HAS ANY DATA 
UNDERGONE TIME OUT? 



YES 



SET SYSTEM-BIN 
ABNORMAL STATE 



DELETE CORRESPONDING 
RECEPTION DATA FROM 
SYSTEM-A RECEPTION QUEUE 



DATA IN SYSTEM-B 
RECEPTION QUEUE? 



YES 



HAS ANY DATA 
UNDERGONE TIME OUT? 



YES 



SET SYSTEM-A IN 
ABNORMAL STATE 



DELETE CORRESPONDING 
RECEPTION DATA FROM 
SYSTEM-B RECEPTION QUEUE 



( END ) 
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